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Abstract 

This paper considers the distributed consensus problems for multi-agent systems with general linear 
{/y , and Lipschitz nonlinear dynamics. Distributed relative-state consensus protocols with an adaptive law 

for adjusting the coupling weights between neighboring agents are designed for both the linear and 
nonlinear cases, under which consensus is reached for all undirected connected communication graphs. 
Extensions to the case with a leader-follower communication graph are further studied. In contrast to 

> ; 

0^ \ the existing results in the literature, the adaptive consensus protocols here can be implemented by each 

o\ . 

. agent in a fully distributed fashion without using any global information. 
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H , I. Introduction 

In recent years, the consensus problem for multi-agent systems has received compelling 
attention from various scientific communities, for its potential applications in such broad areas 
as spacecraft formation flying, sensor networks, and cooperative surveillance 01, ED- A general 
framework of the consensus problem for networks of integrator agents with fixed and switching 
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topologies is addressed in Q. The conditions given by O are further relaxed in [4J. A distributed 
algorithm is proposed in Q to achieve consensus in finite time. Distributed consensus 
and control problems are investigated in [O, Q for networks of agents subject to external 
disturbances and model uncertainties. Consensus algorithms are designed in (8]|, for a group 
of agents with quantized communication links and limited data rate. The authors in ifTOll studies 
the controllability of leader-follower multi-agent systems from a graph-theoretic perspective. To 
ensure that the states of a group of agents follow a reference trajectory of a leader, consensus 
tracking algorithms are given in ifTTI . [fT2ll for agents with fixed and switching topologies. 
A passivity-based design framework is proposed in lfT3l to achieve group coordination. The 
consensus problems for networks of double- and high-order integrators are studied in 031, 0"5l . 
[fT6l . Readers are referred to the recent surveys [TJ, $2% for a relatively complete coverage of the 
literature on consensus. 

This paper considers the distributed consensus problems for multi-agent systems with general 
linear and Lipschitz nonlinear dynamics. Consensus of multi-agent systems with general linear 
dynamics was previously studied in lfT71 . lfT8l . Ifl9l . [|20l . In particular, different static and 
dynamic consensus protocols are designed in ifTTll . lfT8l . requiring the smallest nonzero eigenvalue 
of the Laplacian matrix associated with the communication graph to be known by each agent 
to determine the bound for the coupling weight. However, the Laplacian matrix depends on the 
entire communication graph and is hence global information. In other words, these consensus 
protocols in IfTTI . [fT8l can not be computed and implemented by each agent in a fully distributed 
fashion, i.e., using only local information of its own and neighbors. To tackle this problem, we 
propose here a distributed consensus protocol based on the relative states combined with an 
adaptive law for adjusting the coupling weights between neighboring agents, which is partly 
inspired by the edge-based adaptive strategy for the synchronization of complex networks in 

eh, ea. 

The proposed distributed adaptive protocols are designed, respectively, for linear and Lipschitz 
nonlinear multi-agent systems, under which consensus is reached in both the linear and the 
nonlinear cases for any undirected connected communication graph. It is shown that a sufficient 
condition for the existence of such a protocol in the linear case is that each agent is stabilizable. 
Existence conditions for the adaptive protocol in the nonlinear case are also discussed. It is 
pointed out that the results in the nonlinear case can be reduced to those in the linear case, 
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when the Lipschitz nonlinearity does not exist. Extensions of the obtained results to the case 
with a leader-follower communication graph are further discussed. It is worth noting that the 
consensus protocols in |[19ll , [|20l can also achieve consensus for all connected communication 
graphs. Contrary to the general linear and Lipschitz nonlinear agent dynamics in this paper, the 
linear agent dynamics in |fl9ll are restricted to be neutrally stable and all the eigenvalues of the 
state matrix of each agent in EUll are assumed to lie in the closed left-half plane. In addition, 
adaptive synchronization of a class of complex network satisfying a Lipschitz-type condition 
is considered in ETI . Il22ll . However, the results given in ll2Tll . Il22l require the inner coupling 
matrix to be positive semi-definite, which is not directly applicable to the consensus problem 
under investigation here. 

The rest of this paper is organized as follows. The adaptive consensus problems for multi- 
agent systems with general linear and Lipschitz nonlinear dynamics are considered, respectively, 
in Sections II and III. Extensions to the case with a leader-follower communication graph are 
studied in Section IV. Simulation examples are presented to illustrate the analytical results in 
Section V. Conclusions are drawn in Section VI. 

Throughout this paper, the following notations will be used: Let R nxn be the set ofnxn real 
matrices. The superscript T means transpose for real matrices. I N represents the identity matrix 
of dimension N. Matrices, if not explicitly stated, are assumed to have compatible dimensions. 
Denote by 1 the column vector with all entries equal to one. diag(Ai, • • ■ , A n ) represents a block- 
diagonal matrix with matrices A4, % — 1, ■ • • , n, on its diagonal. For real symmetric matrices X 
and Y, X > (>)Y means that X — Y is positive (semi-)definite. A <g> B denotes the Kronecker 
product of matrices A and B. 

II. Adaptive Consensus for Multi-Agent Systems with General Linear 

Dynamics 

Consider a group of N identical agents with general linear dynamics. The dynamics of the 
i-th agent are described by 

ii = Axi + Bui, i = l,-- ,N, (1) 

where Xi G R n is the state, Ui E R p is the control input, and A, B, are constant matrices with 
compatible dimensions. 
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The communication topology among the agents is represented by an undirected graph Q = 
(V,£), where V = {1, • ■ • , N} is the set of nodes (i.e., agents), and £ C V x V is the set of 
edges. An edge (i, j) (i ^ j) means that agents % and j can obtain information from each other. A 
path in Q from node %\ to node %i is a sequence of edges of the form (i k , ik+i), k = 1, • • • ,1 — 1. 
An undirected graph is connected if there exists a path between every pair of distinct nodes, 
otherwise is disconnected. 

A variety of static and dynamic consensus protocols have been proposed to reach consensus for 
agents with dynamics given by ©, e.g., in ifTTl . lfT8l . [fT9l , ll20ll . For instance, a static consensus 
protocol based on the relative states between neighboring agents is given in [fTTl as 



where c > is the coupling weight among neighboring agents, K e rp x ™ i s the feedback gain 
matrix, and is (i,j)-th entry of the adjacency matrix A associated with Q, defined as an = 0, 
ciij = ciji = 1 if (j, i) G £ and = = otherwise. The Laplacian matrix C = (Cij) NxN of 
g is defined by C u = Y!j=\,j^i a ij and = ~ a ij for % ^ j. 

Lemma 1 (4771/ ): Suppose that g is connected. The agents described by (0Q) reach consensus 
(i.e., Hindoo - Xj(t)\\ = 0, Vi, j = 1, • • • , iV) under the protocol © with iiT = -B T P' 1 

and the coupling weight c > where A 2 is the smallest nonzero eigenvalue of C and P > 
is a solution to the following linear matrix inequality (LMI): 



As shown in the above lemma, the coupling weight c should be not less than the inverse of 
the smallest nonzero eigenvalue A 2 of C to reach consensus. The design method for the dynamic 
protocol in [Tl8l depends on X 2 also. However, X 2 is global information in the sense that each 
agent has to know the Laplacian matrix and hence the entire communication graph g to compute 
it. Therefore, the consensus protocols given in Lemma [TJ and lfT8l cannot be implemented by 
each agent in a fully distributed fashion, i.e., using only the local information of its own and 
neighbors. 

In order to avoid the limitation stated as above, we propose the following distributed consensus 



N 




(2) 



AP + PA T - 2BB T < 0. 



(3) 
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protocol with an adaptive law for adjusting the coupling weights: 

N 

3=1 ' (4) 



where ay is defined as in ©, /% = Kji are positive constants, cy denotes the time-varying 
coupling weight between agents i and j with cy(0) = 0^(0), and F G Rp x " and T G R nXTl are 
feedback gain matrices. 

We next design F and r in © such that the N agents reach consensus. 

Theorem 1: For any given connected graph Q, the TV agents described by (OQ) reach consensus 
under the protocol © with F = -B T P' 1 and T = P' 1 BB T P' 1 , where P > is a solution 
to the LMI ©. Moreover, each coupling weight c i3 - converges to some finite steady-state value. 

Proof: Let x = jfY^j=i x j> e i = x i ~ x -> an d e = [ef , ■ ■ • , e N ] T . Then, we get e = 
((/at — ^fll T ) <8> I n ) x. It is easy to see that is a simple eigenvalue of In — with 1 as 

the corresponding right eigenvector, and 1 is the other eigenvalue with multiplicity N — 1. Then, 
it follows that e = if and only if x\ = • • • = xjy. Therefore, the consensus problem under the 
protocol © can be reduced to the asymptotical stability of e. Using © for ©, it follows that 
e satisfies the following dynamics: 

N 

hi = Ad + V, r :,"ijl !!■'{< i - ej), 

3=1 (5) 



&ij ^ij&ij^&i r(^i Gj ;) , % 1, • • • , ./V". 

Consider the Lyapunov function candidate 

N N N , , 2 

i=l i=l j = l,jfa J 

where q is a positive constant. The time derivative of V\ along the trajectory of © is given by 



N 


N N 

=. + E E 


i=l 


i=i j=ij^t 


N 






I N 


i=i 




N N 




E E < 

i=l j=X,j^i 





(7) 



e j ) T V{e i -e j ). 
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Because ^ = Kji, c i;? (0) = Cjj(O), and T is symmetric, it follows from © that cy(i) = Cjj(i), 
Vt > 0. Therefore, we have 

TV JV 

5^ ( c y - «) a ij( e i - e i) T r( e i - e i) 

i=l 7=1, j^i „ 

(8) 

= 2 Y Y^ ~ a)aiiefr(ei - e 3 -). 
i=i j=i 

Let g< = P~ l ei and e = [ef , • • ■ , e^] T . Substituting F = -B T p- 1 and T = p- l BB T p- 1 into 
©, we can obtain 

JV JV JV 

^ = 2 ^ ef P -1 ^ - 2a Y Y ^ p ' 1 BB T p- 1 {e i - e s ) 
i=i i=i j=i 

TV N N 

= Y eJ(AP + PA T )ei ~^YY ^BB T ~e 3 W 

i=l i=l j=l 

= e T (I N ® (AP + PA T ) - 2aC <g> PP T ) e, 
where £ is the Laplacian matrix associated with 

Because Q is connected, zero is a simple eigenvalue of £ and all the other eigenvalues are 
positive GU. Let 17 e R NxN be such a unitary matrix that U T CU = A = diag(0, A 2 , ■ ■ • , X N ). 
Because the right and left eigenvectors of C corresponding to the zero eigenvalue are 1 and 

r jT i 

1 T , respectively, we can choose U = [vw Yl ] and U T = VN , with Yi G R Nx ( N ~ l ) and 
Y 2 E R^- 1 )*". Let £ = [£f , • • ■ , = (,7 T <g> 7 n )e. By the definitions of e and e, it is easy 
to see that 

6 = ® /n)e ~ = ( 7at ® p ~ 1)e = °' (10) 



Then, we have 

V x = f (I N <g> (AP + PA T ) - 2aA g> PP T ) £ 
= Y^(AP + PA T -2a\, t BB T )^ 

8=2 

By choosing a sufficiently large such that aAj > 1, i — 2, ■ ■ ■ , N, it follows from © that 

AP + PA T - 2a\iBB T < AP + PA T - 2PP T < 0. 

Therefore, Vi < 0. 
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Since V\ < 0, V\(t) is bounded and so is each c^. By noting T > 0, it can be seen from © 
that Cij is monotonically increasing. Then, it follows that each coupling weight c^- converges to 
some finite value. Let S = cy|Vi = 0}. Note that V\ = implies that ^ = 0, i — 2, ■ ■ ■ ,N, 
which, by noticing that £i = in (fTOb . further implies that e = and e = 0. Hence, by LaSalle's 
Invariance principle [24J, it follows that e(i) — >■ 0, as t — >• oo. That is, the consensus problem is 
solved. ■ 

Remark 1: Equation © presents an adaptive protocol, under which the agents with dynamics 
given by © can reach consensus for all connected communication topologies. In contrast to the 
consensus protocols in [fTTl , [fT8l , the adaptive protocol © can be computed and implemented 
by each agent in a fully distributed way. As shown in ifTTl . a necessary and sufficient condition 
for the existence of a P > to the LMI © is that (A, B) is stabilizable. Therefore, a sufficient 
condition for the existence of a protocol © satisfying Theorem 1 is that (A, B) is stabilizable. 

Remark 2: It is worth noting that the consensus protocols in [fT9l . Il20l can also achieve 
consensus for all connected communication graphs. Contrary to the general linear agent dynamics 
in this section, the agent dynamics in [fT9l are restricted to be neutrally stable and all the 
eigenvalues of the state matrix of each agent in [|20l are assumed to lie in the closed left-half 
plane. 

III. Adaptive Consensus for Multi- Agent Systems with Lipschitz Nonlinearity 

In this section, we study the consensus problem for a group of TV identical nonlinear agents, 
described by 

x i = Ax i + D 1 f{x i ) + Bu i , i = l,---,N, (12) 

where X{ G R ra , u, t G R p are the state and the control input of the i-th agent, respectively, A, 
B, Di, are constant matrices with compatible dimensions, and the nonlinear function /(xj) is 
assumed to satisfy the Lipschitz condition with a Lipschitz constant 7 > 0, i.e., 

\\f(x)-f(y)\\<j\\x-yl Wx,yeK n . (13) 

Theorem 2: Solve the following LMI: 

AQ + QA T - tBB t + fD x TD\ Q 



Q -T 



< 0, (14) 
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to get a matrix Q > 0, a scalar r > and a diagonal matrix T > 0. Then, the iV agents described 
by (fl"2l) reach global consensus under the protocol (HJ) with F = —B T Q~ 1 and V = Q~ 1 BB T Q~ 1 
for any connected communication graph Q. Furthermore, each coupling weight converges to 
some finite steady-state value. 

Proof: Using © for (fl"2~)) . we obtain the closed-loop network dynamics as 

TV 

Xi = Ax, + D x f{xi) + r, ; f/, ; /)'/•'(./•, - xj), 

j=i (15) 



As argued in the Proof of Theorem 1, it follows that Cy(t) = Cji(t), V£ > 0. 



Letting x = ± J2f =1 Xj, e { = x~x, and e = [ef , • • • , e^] T , we get e = ((Ijv - |ll T ) ® J n ) 



x. 



By following similar steps to those in Theorem 1, we can reduce the consensus problem of (1151) 
to the convergence of e to the origin. It is easy to obtain that e satisfies the following dynamics: 

^ TV TV 

hi = Ae { + D 1 f(x i ) - — Y D if( x j) + + f3)aijBF(ei - e,-), 

3=1 3=1 (16) 



(ei - ej) T T(ei - ej), i = l,---,N, 



where Cy = c^- + /? and /3 is a positive constant. 
Consider the Lyapunov function candidate 



TV N N ~2 

V 2 = $>fQ-'e, + £ £ 3L. (17) 

i=l i=l j=i,jf^i l ^ 



The time derivative of V 2 along the trajectory of (|I61) is 

TV TV TV 



TV / ^ TV TV 

= 2 ^ ef Q- 1 Ae,, + Z^/fo) - - ^ Di/fo) + £(cy + P)a t] BF(e t - e 5 ) 

i=l \ j=l 3=1 

TV TV 

+ J2 Yl ^jttijiei- e 3 ) T V{ei- ef) (18) 

TV TV TV 

= 2 efQ^Aei ~^YH ^ejQ- 1 BB T Q- 1 e j 

i=l i=l j=l 

TV / TV \ 

+ 2 £ ejQ-'D, /(*,) - /(x) + /(x) - - £ /(x,) , 

i=l V 3=1 / 
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where we have used the fact © to get the last equation. 
Using the Lipschitz condition (TT3T) gives 

2ejQ- 1 D 1 (f(x i ) - f(x)) < 2 1 \\e T i Q- 1 D 1 Tl || ||T^ ei || 

(19) 

< efi^Q-'D.TDjQ- 1 + T- 1 )e i , 
where T is given in CH]). Because £ti ef = 0, we have 

- / 1 N \ 

ejQ' 1 D 1 f(x) f(*i) = 0- ( 20 ) 

»=1 V 3=1 / 

Let ej = (5 _1 ej and e = [ej , • • • , e^] T . In virtue of (fT9~l) and (|20l ), we can obtain from (fT8l) that 

N / N 

V 2 < ef (^<2 + <5^ T + 1 2 D X TD[ + QT^Q)^ -2/3^ C ij BB T e J 



8=1 



i=i / (21) 

= e T (Jjv <g> (AQ + QA r + ^DtTDj + QT~ l Q) - 2^£ <g> ££ T ) e. 
Let [/ G R ArxAr be the unitary matrix defined in the proof of Theorem 1, satisfying U T CU = 
A = diag(0, A 2 , • • • , X N ). Let C = [Cf, • • • , C£] T = (U T ® I n )e. Clearly, Ci = ® <3 _1 )e = 0. 
From (l2"TT) . we have 

V2 < C T (ijv ® (AQ + QA T + 1 2 D 1 TD'( + QT-'Q) - 2/?A ® 5B T ) C 



A? 



^ ^ 0<2 + + 1 2 DyTD[ + QT^Q - 2/3^55) (22) 



i=2 

A 



W(C). 

By choosing (3 sufficiently large such that 2/?Aj > t, i = 2, ■ ■ ■ , N, it follows that 

AQ + QA T - 2(5X l BB T + ^D^Df + QT^Q 

<AQ + QA T - tBB t + j 2 D t TD^ + QT~ X Q 
<0, i = 2,---,N, 

where the last inequality follows from (fl4l) by using the Schur complement lemma [25 J. There- 
fore, w(C) < 0. 

Since V2 < 0, V^(t) is bounded and so is each cy. By (fl6l) . cy is monotonically increasing. 
Then, it follows that each ciy converges to some finite value. Thus the coupling weights 
converge to finite steady-state values. Note that V 2 is positive definite and radically unbounded. 
By LaSalle-Yoshizawa theorem |24|. it follows that lim^oo W(() = 0, implying that Q — > 0, 
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i = 2, ■ ■ ■ , N, as t — > oo, which, together with d = 0, further implies that e{t) — > 0, as t — > oo. 
This completes the proof. ■ 

Remark 3: By using Finsler's Lemma E6l . it is not difficult to see that there exist a Q > 0, 
a T > and a r > such that (fl?)) holds if and only if there exists a K such that (A + 
BK)Q + Q(A + BK) T + ^ 2 D{FD\ + QT~ X Q < 0, which with T = J is dual to the observer 
design problem for a single Lipschitz system in E71 . [|28l . According to Theorem 2 in [28], the 
LMI (fl4l) is feasible, and thus there exists an adaptive protocol (HJ) reaching consensus, if the 
distance to unobservability of (A, B) is larger than 7. Besides, a diagonal scaling matrix T > 
is introduced here in (fl4)) to reduce conservatism. If the nonlinear function f(xi) = in (fT2~l) . 
then (fT2l) becomes ([I]). By choosing T sufficiently large and letting D\ = and r = 2, then (TT4)) 
becomes + QA T — 2BB T < 0. Therefore, for the case without the Lipschitz nonlinearity, 
Theorem 2 is reduced to Theorem 1. 

Remark 4: It should be mentioned that the adaptive law in © for adjusting the coupling 
weights is inspired by the edge-based adaptive strategy in ETTl . 11221 . where adaptive synchroniza- 
tion of a class of complex network satisfying a Lipschitz-type condition is considered. However, 
the results given in J2TJ, (|22| require the inner coupling matrix to be positive semi-definite, and 
are thereby not directly applicable to the consensus problem under investigation here. 

IV. Extensions 

The communication topology is assumed to be undirected in the previous sections, where 
the final consensus value reached by the agents is generally not explicitly known, due to the 
nonlinearity in the closed-loop network dynamics. In many practical cases, it is desirable for the 
agents' states to asymptotically approach a reference state. In this section, we consider the case 
where a network of N + 1 agents maintains a leader-follower communication structure. 

The agents' dynamics remain the same as in (Q~|). The agents indexed by 1, • • ■ , N, are referred 
to as followers, while the agent indexed by is called the virtual leader whose control input 
Uq = 0. The communication topology among the TV followers is represented by an undirected 
graph Q. It is assumed that the leader receives no information from any follower and the state 
of the leader is available to only a subset of the followers (without loss of generality, the first 
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q followers). In this case, the following distributed consensus protocol is proposed 



U; 



N 

0=1 



Cij Kjij(Xij\Xi ^j) *- ^jj") 

ti = Kidi(xi - x ) T f(xi -x ), i = 1, • • • , TV, 
where a^, c^, Kij are defined as in dU), Cj denotes the coupling weight between agent % and the 
virtual leader, Ki are positive constants, F G R pxn and f G R nxn are feedback gain matrices, 
and di are constant gains, satisfying di > 0, i — 1, - • • , q, and di — 0, % — q + 1, • • • , N. 

The objective here is to design F G R pxn and f G R nxn such that the states of the followers 
can asymptotically approach the state of the leader in the sense that lim^oo \\xi(t) —x (t)\\ = 0, 
Vi = l,--- ,N. 

Theorem 3: Assume that Q is connected and at least one follower can have access to the 
leader's state. Then, the states of the N followers asymptotically approach the state of the 
leader, under the protocol ([23]) with F = -B T P' 1 and f = P' 1 BB T P' 1 , where P > is a 
solution to ©, and the coupling weights and q converge to finite values. 

Proof: Let = Xi — x , i = 1, • ■ ■ ,N. Then, the collective network dynamics resulting 
from (0Q) and (1231) can be written as 

Ei = Aei + BF ''■j">:S ~ £ j) + CidiSij , 

^ rp . (24) 

Cij Kij(Xij{Ei Sjj r(^i £ j) ; 

di = Kidiejfei, i = l,---,N. 



Clearly, the states of the followers under (1231) can asymptotically approach the state of the leader, 
if (|24|) is asymptotically stable. 

Consider the Lyapunov function candidate 

N N N ( n\2 N I Q\1 

k 3 = E^<+E E <£^ + e<^, (25) 

«=1 1=1 J = l : J=£l J 1 = 1 

where (3 is a positive constant. The rest of the proof follows similar steps to those in Theorem 
1, and by further noting the fact: Suppose that R = diag((i 1 , d 2 , ■ ■ ■ , djy) > with at least one 
diagonal item being positive. Then, £ + R is positive definite if Q is connected ifTTfl. ■ 
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Remark 5: It is worth mentioning that an adaptive pinning scheme similar to (|23l ) has been 
proposed in [29]. Compared to [ 2~9j where the inner coupling matrix is an identity matrix, the 
adaptive protocol (|23l) here is more general. 

The case with the agents described by (PT21) can be discussed similarly, and is thus omitted 
here for brevity. 

V. Simulation Examples 

In this section, a simulation example is provided to validate the effectiveness of the theoretical 
results. 




Fig. 1: The communication topology. 



Consider a network of single-link manipulators with revolute joints actuated by a DC motor. 



A 



1 

-48.6 -1.25 48.6 



1.95 -1.9E 



with (see ESI) 




o" 




' 





, B = 


21.6 


10 
















-0.333sin(x 



'3, 



Di = J 4 , f(xi) 

Clearly, f(xi) here satisfies (TT3T) with a Lipschitz constant 7 = 0.333. 

Solving the LMI CLU by using the LMI toolbox of Matlab gives the feedback gain matrices 
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in © as 



-1.8351 -0.2144 1.0309 -2.247 



3.3676 0.3935 -1.8917 4.1236 
0.3935 0.046 -0.221 0.4818 
-1.8917 -0.221 1.0627 -2.3164 
4.1236 0.4818 -2.3164 5.0492 
To illustrate Theorem 2, let the communication graph Q be given in Fig. 1. Here Q is undirected 
and connected. Let «y = 1, i, j — 1, • • ■ , 8, in ([4]), and c,j(0) = Cji(0) be randomly chosen. The 
states trajectories of the eight manipulators under the protocol © are depicted in Fig. 2, from 
which it can be observed that consensus is reached. The coupling weights are shown in Fig. 
3, which converge to finite steady- state values. 





Fig. 2: The states of the eight manipulators under 



VI. Conclusion 



In this paper, the distributed consensus problems have been considered for multi-agent sys- 
tems with general linear and Lipschitz nonlinear dynamics. Distributed relative- state consensus 
protocols with an adaptive law for adjusting the coupling weights between neighboring agents 
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1 2 3 4 5 

t 



Fig. 3: The coupling weights q 



are designed for both the linear and nonlinear cases, under which consensus is reached for 
all undirected connected communication graphs. Extensions to the case with a leader-follower 
communication graph have also been studied. 
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